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Minimum  Discrimination  Information  Estimation  and  Application 


S.  Kullcacic 

Tne  George  Wasnington  University 
Wasnington,  D.  C.  20006 

ADstract 

Tnis  paper  presents  in  some  detail  tne  application  of 
tne  minimum  discrimination  information  tneorem  to  tne  analysis 
of  multidimensional  contingency  taDles.  It  is  snown  tnat  tne 
form  of  tne  minimum  discrimination  information  estimate  as  a 
memoer  of  an  exponential  family  provides  a  regression 
expression  for  tne  logaritnm  of  tne  estimate.  Computational 
procedures  for  tne  evaluation  of  tne  regression  parameters  and 
tne  minimum  discrimination  information  estimates  are  descrioed 
along  witn  tne  tests  for  tne  nypotneses  as  provided  Dy  tne 
minimum  discrimination  information  statistics. 

0.  Introduction.  Tnis  paper  is  related  to  [91  and  [10")  in  wnlcn 
certain  Dasic  tecnniques  and  procedures  were  presented  for  tne 

1  Supported  in  part  oy  tne  Air  Force  Office  of  Scientific  Researcn, 
-££ficg  of  Aerospace  ResTOrcRy  United  States  Air  Force,  under 
Grant  AFOSR-68-1513. 
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analysis  of  multidimensional  contingency  taDles.  In  tnls  paper 
we  snail  examine  tne  underlying  tneory  In  greater  detail  and 
present  one  important  area  of  application.  In  particular  we 
snail  detail  tne  close  analogy  of  tnis  application  witn 
multivariate  regression  analysis.  Altnougn  tne  ingredients  of 
tne  underlying  tneory  were  discussed  in  [ill  it  seems  necessary 
and  desirable  to  present  tnese  ideas  nere  in  greater  detail. 

We  also  remarK  tnat  a  more  extensive  computer  program  tnan 
tnat  descrioed  in  [6]  and  [9]  nas  been  prepared  by  Professor 
Ireland  of  Tne  George  Wasnington  University.  Tnis  new  program 
can  nandle  tables  of  nigner  dimension  tnan  four-way  contingency 
taDles  and  also  provides  tne  values  of  additional  useful 
parameters . 

It  snould  De  pointed  out  tnat  tnere  are  otner  areas  of 
a;  plication  of  minimum  discrimination  information  estimation 
tnan  tnat  considered  in  detail  in  tnis  paper,  for  example,  [3], 
C  ,  [51,  [71,  [11],  [12],  [13],  [14].  Tne  particular 
application  we  snail  consider  nere  can  oe  descrioed  as  fitting 
tne  oDserved  values  in  tne  cells  of  a  contingency  table  In 
terms  of  a  regression  based  on  sets  of  observed  marginals  as 
explanatory  variables. 

1.  Discrimination  Information.  To  maxe  tne  discussion  more 
specific  we  snail  present  it  in  terms  of  tne  analysis  of  four¬ 
way  contingency  tables.  All  tne  essential  features  of  a  more 
general  presentation  appear.  Let  us  consider  tne  space  ft 


of  four-way  contingency  tables  RXSxTxuof  dimension 
rxSxtxuso  tnat  tne  generic  variable  is  u>  -  (i,j,K,t), 

i  -  l,...,r,  j  -  l,...,s,  K  -  l,...,t,  l  -  1 . u.  Suppose 

tnere  are  two  probability  distributions  or  contingency  tables 
(  we  snail  use  tnese  terms  intercnangeably  )  defined  over  tne 
space  0,  say  p(m),  it  (id),  ^  p(id)  -  1,  ^  tt(id)  -  1.  Tne 
discrimination  information  is  defined  by 

(1.1)  I (p :tt)  -  2  p(u))  In  Bjsil  . 

n  tt  (id) 

Tne  oasis  for  tnis  definition,  its  properties,  and  relation  to 
otner  definitions  of  information  measures  may  be  found  in  [11], 
in  tne  Proceedings  of  [131  and  references  tnerein.  For  tne 
particular  types  of  application  of  interest  nere  tne  n-distribution, 
n  (id  ,  in  tne  definition  (1.1)  according  to  tne  problem  of 
interest  may  eitner  be  specified,  or  it  may  be  an  estimated 
distribution,  or  it  may  be  an  observed  distribution.  Tne 
p-distributlon,  p (id ) ,  in  tne  definition  (1.1)  ranges  over  or 
is  a  member  of  a  family  of  distributions  of  interest. 

Of  tne  various  properties  of  l(p:n)  we  mention  in  particular 
tne  fact  tnat  I(p:n)  >  0  and  -  0  if  and  only  if  p(u>)  -  tt(id). 

2.  Minimum  discrimination  information  estimation.  Many 
problems  in  tne  analysis  of  contingency  tables  may  be  characterized 
as  estimating  a  distribution  or  contingency  table  subject  to 
certain  restraints  and  tnen  comparing  tne  estimated  table  witn  an 
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observed  taDle  to  determine  wnetner  tne  observed  table 
satisfies  a  null  nypotnesis  implied  by  'one  restraints.  In 
accordance  witn  tne  principle  of  minimum  discrimination 
information  estimation  we  select  tnat  member  of  tne  family 
of  p-distrioutions  satisfying  tne  restraints  wnicn  minimizes 
tne  discrimination  information  l(p:n)  over  tne  family  of 
pertinent  p-distrioutions.  We  denote  tne  minimum  discrimination 
information  estimate  by  p*(iu)  so  tnat 

(2.1)  I(p*:tt)  -  Z  in  P*Jja)  -  min  I(p:rr). 

tt  (it) 

Unless  otnerwise  stated,  tne  summation  is  over  n  wnicn  will  be 
omitted. 

In  one  class  of  problems  tne  restraints  specify  some 
requirement  external  to  tne  observed  values,  for  example,  tnat 
a  set  of  marginals, nave  specified  values  as  determined  by  genetic 
or  otner  tneory  [41,  [5),  [12l,  or  tnat  marginals  oe  ncmogeneous 
[31.  [14],  or  tnat  tne  distribution  satisfy  certain  symmetry 
conditions  [31.  In  sucn  problems  tt(u>)  Is  taxen  to  be  an  observed 
contingency  table,  tnat  Is,  x(iu)  -  x(ijxt)  -  nrr(ijW-),  wnere 
n  -  l  x(u>) . 

In  anotner  class  of  problems  tne  restraints  specify  tnat  tne 
estimated  distribution  or  contingency  table  nave  some  set  of 
marginals  wnicn  are  tne  same  as  tnose  of  an  observed  contingency 
table.  In  sucn  cases  tt(uj)  Is  taxen  to  be  eitner  tne  uniform 
distribution  tt(IjkI)  -  1/rstu  or  a  distribution  already  estimated 
subject  to  restraints  contained  in  and  implied  by  tne  restraints 
under  examination.  Tne  latter  case  Includes  tne  classical 


nypotneses  of  Independence,  conditional  Independence,  nomogeneity, 
conditional  nomogeneity  and  interaction,  all  of  wnicn  can  be 
considered  as  instances  of  generalized  independence  C 33 ,  [63, 

[73,  [81,  [93,  [10],  [133,  and  will  De  considered  in  some  detail 
In  tnis  paper. 

3.  Minimum  discrimination  information  statistic.  To  test 
wnetner  an  observed  contingency  table  satisfies  tne  null 
nypotnesis  as  represented  by  tne  minimum  discrimination 
information  estimate  we  compute  a  measure  of  tne  deviation 
between  tne  observed  distribution  and  tne  appropriate  estimate 
oy  tne  minimum  discrimination  information  statistic.  For 
notational  convenience  and  later  computational  convenience  let 
us  denote  tne  estimated  contingency  table  in  terms  of 
occurrences  oy  X*(uj)  -  np*(iu),  tnen  for  tne  first  category  of 
problems,  tnat  Is,  witn  restraints  determined  by  external 
considerations,  tne  minimum  discrimination  information  statistic 
turns  out  to  be 

(3.1)  21  (x*  :x)  -  22  x*(uj)  tn  x* 

x(uj) 

wnicn  Is  asymptotically  distributed  as  a  xa  witn  appropriate 
degrees  of  freedom  under  tne  null  nypotnesis.  For  tne  second 
category  of  problems,  tnat  is,  witn  tne  restraints  implied  by 
e  set  of  observed  marginals,  or  tnose  of  a  generalized 
independence  nypotnesis,  tne  m.d.i.  statistic  is 
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(3.2)  2I(x:x*)  -  22  x(u))  tn  ~~ 

X*  (#)) 

wnicn  Is  asymptotically  distriouted  as  a  \3  witft  appropriate 
degrees  of  freedom  under  tne  null  nypotnesis. 

Tne  statistic  in  (3.2)  is  also  minus  twice  tne  logarithm 
of  tne  liKelinood  ratio  statistic  nut  tnis  is  not  true  for 
tne  statistic  in  (3.1)  or  in  otner  applications  [11], 

4.  Minimum  discrimination  Information  theorem.  We  now  present 
a  theorem  wnicn  is  tne  oasis  for  tne  principle  of  minimum 
discrimination  information  estimation  and  its  applications.  We 
snail  present  it  in  a  form  related  to  tne  context  of  tnis 
discussion  on  tne  analysis  of  contingency  taoles. 

Let  us  consider  tne  space  0  mentioned  in  section  1  and 
tne  discrimination  information  introduced  in  (1.1).  Suppose 
now,  for  example,  tnat  we  nave  three  linearly  independent 
statistics  of  interest  defined  over  tne  space  ft 

(4.1)  T4  (») ,  T,  («) ,  Ta  (u>) . 

Let  us  determine  tne  value  of  p(iu)  wnicn  minimizes  tne 
discrimination  information 

(4.2)  I(p:n)  -  2  p(uj)  in 

tt(uj) 

over  tne  family  of  p-distrltutions  wnicn  satisfy  tne  restraints 
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2  Tx  (u>)  p(u>)  -  ei 
(4.3)  2  t9  (id)  p(iu)  -  e* 
I  Ts  (id)  p(uj)  -  e* 


wnere  6f,  0*  are  specified  values. 

If  jt(ui)  satisfies  tne  restraints  (4,3)  tnen  of  course 
tne  minimum  value  of  l(p:n)  is  zero  and  tne  minimizing  distriDution 
is  p#(ui)  -  it  (id).  More  generally,  tne  minimum  discrimination 
Information  tneorem  [  111  states  tnat  tne  minimizing  distribution 
is  given  by 

(4.4)  p*(id)  -  +Ta^(u>)  +  Ta  Ts  (id )').  tt  (id) 

M(ti  ,r8  ,ra  ) 

wnere 

(4.5)  M(Tl,T8,Ta)  -  2  exp(Tl Tj  (id)  +  tsT ,(id)  +  raTa(ui ))  tt(id) 

and  tne  t's  are  parameters  wnicn  are  in  essence  undetermined 
Lagrange  multipliers  wnose  values  are  defined  In  terms  of 

e*.  e*  by 

%  M(Tt  ,T8,TS)  - 

-  (2  exp  (t  T  (id)  +  t#t„  (id)  +  t#T,  (id)  )TX  (id)tt(id)  )  A(ti  ,t8  ,t#  ) 


(4.6)  9*  -  — tn  M(t1  ,t8  ,t8  )  - 

O  t3 

-  (z  exp(r1T1(ui)  +  t8T8(u>)  -htsTs  (oi))t8  (iu)tt(o)))/M(t1  ,ts  ,t5  ) 

6*  MCVVt.)  - 

-  (Z  exp  (TjTj  (ui)  +t8T8(ui)  +  ',T,  (u>)  )TS  (u»)tt(u>)  ,t,  ,tb  )  . 

We  can  now  state  a  number  of  consequences  of  tne  preceding. 

We  note  first  tnat  p*(ui)  is  a  member  of  an  exponential 
family  of  distributions  generated  by  r.  (ui)  and  as  sucn  nas  tne 
properties  of  members  of  an  exponential  family.  In  particular 
p*(iu)  -  tt  (u) )  for  -  rg  -  ts  -  0.  We  may  also  write  (4.4) 

(4.7)  *n  -  -  tn  M(Ta  ,r8  ,t8  )  +rl^(»)  +raTa(«>)  +  tst3(w) 

vr(m) 

-  L  +  Tj  Tj  («0  +  t8T8  (u>)  +  TtTs  (ui) 

witn  L  -  -  tn  M(Tt  »t8 ,ts ) .  Tne  regression  expression  in  (4.7) 
for  tn(p*  (uj)/n  (uo) )  witn  Tj(ui),  Ta  (ou )  r  Ts  (ui)  as  tne  explanatory 
variables  and  t  ,t#  ,t3  as  tne  .regression  coefficients  plays  an 
important  role  ir.  tne  analysis  we  snail  consider. 

We  note  next  tnat  tne  minimum  value  of  tne  discrimination 
information  (4.2)  Is 

(4.8)  I(p*:tt)  -  t1Q*  +  fa9*  +  TjSJ  -  tn  M(t,  ,ra  ,ra ) 
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wnere  tne  9  *s  are  defined  in  (4.3)  and  tne  t's  are  determined  to 
satisfy  (4.6) .  Using  tne  value  in  (4.7)  it  may  De  snown  tnat  if 
p(iu)  is  any  member  0f  tne  family  of  distributions  satisfying  (4.3), 
tnen 

(4.9)  I(p:TT)  -  I(p:p*)  +  I(p#:n). 


Tne  pytnagorean  property  (4.9)  plays  an  important  role  in  tne 
analysis  of  information  tables. 

We  note  tnirdly  relatic  s  connecting  tne  9*'s,  tne  t's, 
and  tne  covariance  matrix  of  tne  T(u))'s.  If  we  define  tne 
matrices  (vectors) 

(del)'  -  d6?»  <*«£)»  (*l)'  "  (dTi»  dTs.  dTs ) 

tnen  [11,  p.49] 

(4.10)  (d9*)  -2#(dT),  (dT)  -  Z*"1 (d9*) 


wnere  z*  is  tne  covariance  matrix  of  Tj  (m),  Ta  (ui),  Ta  (m)  for  tne 
distribution  p*  (u>) ,  tnat  is,  witn 


a*j  -  S(T,  (is)-©*)  (T4  (w)-e*)p*(u»),  / 


(a**1) 


(4.n) 

aT, 


Prom  (4.5)  it  Is  seen  tnat  M(tj  ,Tg  ,t3  )  is  tne  moment -gene rating 
function  of  ^(m),  Ta(iu),  T#  (id)  under  tne  distribution  u  (id)  ,  nence 
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tne  cumulant-gene rating  function  ia  given  up  to  quadratic  terms 

ay 

(4.12)  tn  M(t1,tsi,t,)  «  ®1t1  +  S8t,  +  63ts  +  hz  ati  t,  t, 
vine  re 

(4.13)  0,  -  2  T,  (iu)  tt(uj),  otl  -  l(T,  (u))  -  )  (T<  (Ul)  “  ®l )  TT^‘ 

Tnus,  using  (4.12)  in  (4.6),  we  get 

6*  “  ei  +  f  CTu  T( 

(4.14)  e*  «  ea  +  2  oai  Tj 

ej  -  0S  +  f  °.)  Ti 

and  tnen  using  (4.14)  in  (4.8)  yields 

(4.15)  2I(p*:tt)  *  (6*  -  8)'  2 1  (®*  -  ®)  “  l'  £  I* 

We  nave  used  tnree  functions  T, (w) ,  Ta (u>) ,  Ta (»)  tnus  far 
in  tne  discussion  merely  as  a  matter  of  convenience.  We  note  tnat 
(4.15)  nolcfs  for  a  set  of  m  functions  T,  (*) ,  i  -  l,...,m  witn 
appropriate  meanings  for  tne  matrices.  Let  us  partition  ta»  z** 
of  m  functions  Tf  (ui)  into  a  set  Ha  say  of  m,  and  a  set  H„  of  tne 
remaining  m,  -  m  -  n.  functions,  wnere  tne  functions  in  tne  set  Ha 

nave  tne  property  tnat 
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(4.16)  9*  -  es  ,  1  -  1 . m#  . 

We  nave  tne  related  partitioning  of  tne  covariance  matrix  of  tne 

(u))  *  i  "  1* 

(4.17) 

and  tne  9,  9*,  and  t_  matrices 

(4.18)  9*'  -  (<£' ,<£'),  9'-  (9,' ,  9j),  t_»  -  (tJ  ,  tJ  ) . 

In  terms  of  tne  partitionings  in  (4.17)  and  (4.18)  tne 
relations  in  (4.14)  may  De  written  as 

©*  =  9  +  *  r  +  y  t 

(^.19)  r  r 

S?  «  e.  +2..  1.  +  &.  1 

and  using  tne  fact  tnat  G£  -  9,  ,  it  is  found  tnat  using  tnese 
results  in  (4.8)  now  yields 

(4.20)  2I(p*:tt)  «  (9*  -  9. ) '  Z^..  (£  -  9. )  *  jJ  2, ...I, 

wnere  *  -  s  -  Z..  £*  Z.„  is  an  m.  x  ma  matrix.  Tne 

results  under  tne  partitioning  will  nelp  in  Interpreting  tne 
analysis  of  Information  values  and  are  similar  to  tnose  occurring 
in  tne  testing  of  suonypotneBes  in  tne  linear  and  multivariate 
linear  nypotnesis  tneory  til,  p.  216,  2591 • 


li 


We  note  from  (4.6)  and  (4.7)  tnat 


(4.21)  in  p*  (ui)  -  T  (uj)  -  JL_  in  M(t.  ,T.  ,...)-  T.  (u>)  -  Gf  f 

3T,  9t,  18  1  1 


nence  T  (uu )  is  tne  maximum  liselinood  estimator  of  ©*  .  Tnus  if 
we  write  Tj  (w)  -  and  denote  tne  values  satisfying  (4.6)  or 
(4.14)  witn  0*  in  place  of  9*  and  in  place  of  t  t  we  nave 
corresponding  to  (4.15) 


(4.22)  21  (p*  ht )  -  2  2  Tf  Gf  -  2  In  M(?x  ,...) 

«  (e*  -  @) '  (i>*  -  01  *  t_'  L  L 


and  corresponding  to  (4.20) 


(4.23)  2I(p*:tt)  -  (£  -  0, ) '  -  0, )  -  t,' 


We  remarx  tnat  tne  covariance  matrix  of  tne  t*s  is  tne  Inverse  of 
tne  covariance  matrix  of  tne  T  (id)  's. 


If  tne  0t  are  tne  averages  of  n  independent  oDservations 


tnen  we  nave  for  tne  minimum  discrimination  information  statistics 


(4.2'  2n  l(p*  sir)  «  n(©»  -  0) »  271  (©*  -  0)  *  n  ]_ »  X  1 


and  in  tne  partitioned  case 


(4.25)  2n  I (p*  :tt )  •  n(0j  -  ©.)'  ( Sf  -  0, )  -  n  £•  J,,., 
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Under  tne  null  nypotnesis  2n  l(p*:rr)  In  (4.24)  or  (4.25)  Is 
asymptotically  distrlDutea  as  X3  respectively  witn  m  or  m# 
degrees  of  freedom. 

5.  Computational  procedures.  An  experiment  nas  teen  designed 
and  observations  made  resulting  In  a  multidimensional  contingency 
table  witn  tne  desired  classifications  and  categories.  All 
tne  information  tne  experimenter  nopes  to  obtain  from  tne 
experiment  is  contained  In  tne  contingency  table.  In  tne  process 
of  analysis,  tne  aim  Is  to  express  tne  observed  table  by  a 
number  of  parameters  depending  on  some  or  all  of  tne  marginals, 
tnat  is,  to  find  out  now  mucn  of  tnis  total  information  is 
contained  in  a  summary  consisting  of  sets  of  marginals.  Indeed, 
tne  relationsnip  between  tne  concept  of  independence  or  association 
and  interaction  in  contingency  tables  and  tne  role  tne  marginals 
play  is  evidenced  in  tne  writings  of  Bartlett  [ll,  Simpson  [17], 

Roy  and  Kastenoaum  [16],  Lewis  [15],  Darrocn  [2]  and  otners  on 
tne  analysis  of  contingency  tables.  Tnus,  tne  e's  in  tne 
preceding  discussion  will  be  tne  marginals  of  interest. 

5.1.  Tne  T(uj)  functions.  Tne  T(tu)  functions  for  tne  R  x  S  x  T  x  u 
table  turn  out  to  be  a  basic  set  of  simple  functions  and  tneir 
various  products.  Tnus,  for  example,  tne  T(uj)  function  associated 
witn  tne  one-way  marginal  p(2...)  is 

(5-1)  T^(ijKt)  -  1  for  i  -  2,  any  j,K,l 
-  0  otnerwise 


13 


since 


(5.2)  2  p(ijKt)  TgR(ijKt)  -  p(2...). 

Similarly  tne  T(ui)  function  associated  witn  tne  one-way  marginal 
p(..3.),  for  example,  is 

(5.3)  tJ ( ij Kt )  -  1  for  k  -  3,  any  i,j 

-  o  otnerwise 


since 

(5.4)  2  p(ijKt)  Tj(ijfct)  -  p(. .3.) . 


^(ijKf-),a-l,...,r-l 
of (ijKt).fl-l, ...,s-l 
Ty(ijRl)  ,Y-1, . .  .,t-l 
T^(ijKt),6-l,...,u-l, 

since,  for  example, 

2  2  T.R(ijKt)  -  rstu  . 

a  -i 

We  nave  aroitrarly  excluded  tne  functions  corresponding  to 
a  -  r,  fl-s,  y-t,  6-u  as  a  matter  of  convenience,  we  could 
nave  selected  a  -  1,  *  -  1,  y  -  1,  #  -  1  or  any  otner  set  of  values. 


Tnus  for  tne  r  x  s  x  t  x  u  taole  we  nave 

(r-1)  linearly  independent  functions 

(s-1)  linearly  independent  functions 
(5.5)  ,  % 

(t-1)  linearly  Independent  functions 
(u-1)  linearly  independent  functions 
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Tne  T(i»)  function  associated  witn  tne  two-way  marginal 
p(12. . )  say,  is  T^(ijKt)  if(ijKt)  since  from  tne  definition  of 
T^(ijKt)  and  Tg (ijKt)  it  may  De  seen  tnat 

(5.6)  Tf(ijKt)  Tf(ijKt)  -  1  for  1-1,  1-2,  any  K,l 

-  0  otnerwise 

and 

(5-7)  X  p(lJKt)  T^(ijKt)  Tf(ijKt)  -  p(12. .) . 

Tnus  tne  T(ui)  function  associated  witn  any  two-way  marginal  is 
a  product  of  two  appropriate  functions  of  tne  set  (5*5). 

Similarly  tne  T(u>)  function  associated  witn  any  tnree-way 
marginal  will  De  a  product  of  tnree  of  tne  appropriate  functions 
of  tne  set  (5-5),  for  example, 

(5.8)  I  p(lJKt)  if(ijKt)  T^(ijKt)  T^ljirt,)  -  p(2.13). 

Similarly  tne  T(u»)  function  associated  witn  any  four-way 
marginal  will  De  a  product  of  four  of  tne  appropriate  functions 
of  tne  set  (5-5),  for  example, 

(5-9)  X  P(1JK/J  TaVm)  Tf(iJKt)  Tj’(iJKt)  T8U(iJK/,)  -  p(2112)  . 

We  note  tnat  tne re  are  a  total  of 
Na  -  (r-1)  +  (s-1)  +  (t-1)  +  (u-1) 

N„  -  (r-1)  ( s-1) +( r-1)  (t-1)  +(r-l)  (u-l)+(s-l)  (t-l)+(s-l)  (u-l}+(t-l)(u-3) 
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N3-(r-l) (s-l) (t-l)+(r-l) (s-l) (u-l)+(r-l) (t-1)  (u-l)  +  (a-l) (t-1) (u-1) 
N4”(r-1) (s-1)  (t-1) (u-1) 

respectively  of  tne  simple  linearly  independent  functions  and 
tneir  products  two,  tnree,  four  at  a  time.  It  may  be  verified 
tnat 

(5.10)  rstu  -  1  -  N  -  +  N#  +  Ns  +  N4  . 

Tnese  values  are  degrees  of  freedom  in  tne  analysis  of  information 
tables  in  [6),  [101. 

5.2.  Tne  p»(m)  values.  In  tne  usual  regression  analysis 
procedure,  one  first  computes  tne  regression  coefficients  and 
tnen  gets  tne  values  of  tne  estimates.  In  tnis  case  nowever  we 
reverse  tne  procedure.  Instead  of  trying  to  obtain  tne  values 
of  tne  t's  from  (4.6)  we  snail  first  obtain  tne  values  of  p*(iu) 
by  a  straigntforward  convergent  iterative  procedure  and  tnen 
derive  tne  values  of  tne  t's  from  (4.7).  We  snail  not  discuss 
tne  details  of  tne  Iteration  nere  since  tney  nave  been  described 
in  [4],  [61,  [9"1,  [101.  Tne  Iteration  may  be  described  as 
successively  cycling  tnrougn  adjustments  of  tne  marginals  of 
interest  starting  witn  tne  it(iu)  distribution  until  a  desired 
accuracy  of  agreement  between  tne  set  of  observed  marginals  of 
interest  and  tne  computed  marginals  nas  been  attained. 

5.5.  Tne  t  values.  From  tne  definitions  of  tne  T (u>)  functions 

in  section  5.1  it  Is  clear  tnat  tney  tase  on  only  tne  values 

0  or  1  for  eacn  value  of  iu.  From  tne  nature  of  tne  T(uj) 

functions  tne  set  of  regression  equations  (4.7)  will  nave  some 
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witn  a  single  t  value  wnicn  can  be  determined.  Tnen  tnere  will 
De  a  set  witn  one  additional  unxnown  value  and  some  of  tne  t ' s 
already  determined.  Tnese  new  umcnown  j  values  can  be  tnen 
determined.  Tnis  process  of  successive  evaluation  is  carried 
on  until  all  tne  values  of  t  are  determined. 


6.  Analysis  of  Information.  Altnougn  tne  preceding  tneoretical 
discussion  nas  been  in  terms  of  proDaDilities,  estimated 
probabilities  or  relative  frequencies,  in  practice  it  nas  been 
found  more  convenient  not  to  divide  everytning  Dy  n,  tne  total 
number  of  occurrences,  and  deal  witn  observed  or  estimated 
occurrences,  tnat  is,  witn  nrr  (ijKl)  -  n/rstu,  x(IjKt),  x(i...), 
x(.jk.),  x*(ijKt)  -  n  p*(ijKt)  etc.  Tne  analysis  of  Information 
is  cased  on  tne  fundamental  relation  (4.9)  for  tne  minimum 
discrimination  Information  statistics.  Specifically  If  n  p*(ui)  - 
x*(uj)  Is  tne  minimum  discrimination  information  estimate 
corresponding  to  a  set  of  given  marginals  and  x*  (ua)  is  tne 
minimum  discrimination  Information  estimate  corresponding  to  a 
set  of  given  marginals,  wnere  Ht  c  l^,  tnen  tne  basic  relations 


2l(x:nrr)  -  2I(Xjsm)  +  2l(x:x*) 
2l(x:nn)  -  2l(x*:n rr)  +  2l(x:x*) 
2l(x*:m)  -  2l(x^:nrr)  +  2l(x*:x^) 
2l(x;xJ)  -  2I(x*:xJ)  +  2l(x:x*) 
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In  terms  of  tne  representation  in  (4.4)  as  an  exponential 
family,  for  our  discussion,  tne  two  extreme  cases  are  tne  uniform 
distribution  for  wnicn  all  t's  are  zero,  and  tne  ooserved 
contingency  tacle  or  distriDution  for  wnicn  all  N  -  rstu  -  1 
t's  are  needed. 

Measures  of  tne  form  2l(x:x*),  tnat  is,  tne  comparison  of 
an  onserved  contingency  tacle  witn  an  estimated  contingency  tacle, 
are  called  measures  of  interaction  and  measures  of  tne  form 
2I(x*:x*),  tnat  is,  tne  comparison  of  two  estimated  contingency 
taoles,  are  called  measures  of  effect,  tnat  is  tne  effect  of  tne 
marginals  in  tne  set  Hb  out  not  in  tne  set  H  .  From  tne  results 
in  (4.24)  or  (4.25)  we  see  tnat  2I(x:x*)  tests  a  null  nypotnesis 
tnat  tne  set  of  t  parameters  in  tne  representation  of  tne  ooserved 
contingency  table  x(iu)  out  not  in  tne  representation  of  tne 
estimated  table  x^(tu)  are  zero,  and  2I(x*:x*)  tests  a  null 
nypotnesis  tnat  tne  additional  set  of  t  parameters  in  tne 
representation  of  tne  estimated  tacle  x£  (uj)  out  not  in  tne 
representation  of  tne  estimated  tacle  x*(u>)  are  zero. 

Since  tne  marginals  of  tne  estimated  tacle  x^(uu)  wnicn 
form  tne  set  of  restraints  used  to  generate  x*(id)  are  tne 
same  as  tne  corresponding  marginals  of  tne  ooserved  x(iu)  tacle 
and  all  lower  order  Implied  marginals, 21 (x:x? )  is  also 
approximately  a  quadratic  in  tne  differences  between  tne 
remaining  marginals  of  tne  x(<u)  tacle  and  tne  corresponding 
ones  as  calculated  from  tne  x*  (us)  table. 

Similarly  2l(x*:x£)  Is  also  approximately  a  quadratic  in 

tne  differences  between  tnose  additional  marginals  in  but  not 

in  H4  and  tne  corresponding  marginal  values  as  computed  from  tne 
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As  we  snail  see,  Decause  of  tne  nature  of  tne  T(uj)  functions 
described  In  section  5-1,  tne  t*s  are  determined  from  tne 
regression  equations  (4.7)  as  sums  and  differences  of  values  of 
•in  x*(ijKt).  A  variety  of  statistics  nave  Deen  presented  in 
tne  literature  for  tne  analysis  of  contingency  tables  wnicn  are 
quadratics  in  tne  marginal  values  or  quadratics  in  tne 
logaritnms  of  tne  observed  or  estimated  values.  Tne  principle 
of  minimum  discrimination  information  estimation  and  its 
procedures  tnus  provides  a  unifying  relationsnip  since  sucn 
statistics  may  be  seen  as  opposite  faces  of  tne  minimum 
discrimination  information  statistic. 

We  nave  presented  tne  approximations  in  terms  of  quadratic 
forms  in  tne  marginals  or  tne  r's  to  assist  in  understanding  and 
interpreting  tne  analysis  of  information  tables  as  a  Dridge 
connecting  tne  familiar  procedures  of  classical  regression 
analysis  and  tne  procedures  proposed  nere.  Tne  covariance  matrix 
of  tne  T(iu)  functions  can  be  estimated  for  eitner  tne  observed 
table  or  any  of  tne  estimated  taDles  and  tne  inverse  of  tnat 
matrix  found  snould  tneir  values  be  desired. 

7.  Tne  2x2  table.  Before  we  present  an  application  of  tne 
preceding  ideas  to  experimental  data  in  a  four-way  contingency 
table,  we  snail  reexamine  tne  2x2  table  from  tne  point  of  view 
of  tnis  paper.  Tne  algebraic  details  are  simple  in  tnis  case  and 
exnibit  tne  unification  of  tne  information  tneoretic  development. 

Suppose  we  nave  tne  observed  2x2  table  in  figure  7.1. 


If  we  fit  tne  one-way 


Figure  7.1 


marginals,  tne  generalized  independence  nypotnesis  is  tne 
classical  independence  nypotnesis  and  tne  minimum  discrimination 
information  estimate  is  x*(ij)  -  x(I.)x(.j)/n  A  convenient 
representation  of  tne  regression  (4.7)  is  given  in  figure  7*2. 
Tne  entries  in  tne  columns  ri  ,  Ta  ,  ta 


1  J 

L 

.  Ti_  T» 

T3 

1  1 

1 

1  1 

1 

1  2 

1 

1 

ro 

4-* 

1 

1 

2  2 

1 

Figure  7-2 


are  respectively  tne  values  of  tne  functions  Tjflj),  ^(Ij),  Ts  (ij) 
associated  witn  tne  marginals  ©t  -  x(l.),  0B  -  x(.l),  6,  -  x(ll), 
and  tne  column  neaded  L  corresponds  to  tne  negative  of  tne 
logaritnm  of  tne  moment-generating  function.  For  tne  oDserved 
distritution,  recalling  tne  regression  (4.7),  it  is  found  tnat 
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(7.1)  L  -  in  (x(22)/n/4),  Tl  -  In  (x(12)/x(22) ) ,  r,  -  in  (x(21)/x(22) ) 

ts  -in  (x(ll)x(22)/x(12)x(21) ) . 


If  we  call  T  tne  matrix  witn  columns  tne  columns  of  Figure  7*2, 
tnat  is, 


(1111 

l  l  °i  °o 
10  0  0 


and  define  a  diagonal  matrix  D  witn  main  diagonal  tne  elements 
x(ij) ,  tnat  is, 


(7.3)  D- 


x(ll)  000 

0  x(12)  0  0 

0  0  x(21)  0 

,  0  00  x(22) 


tnen  it  may  De  verified  tnat  tne  estimate  of  tne  covariance  matrix 
of  tne  Tt  (■)  for  tne  oDserved  contingency  taDle  is  s  -  AB#1  wnere 


(7.4)  A-/-41 
A 

—B  1 


18  j  -  T'DT 
is  / 


(7*5)  ^a.i  “  ^aa  “  £ai 


and  A.  is  1  x  1,  A.  is  3  x  3,  A?  -  A  „  is  1  x  3.  It  is  found  tnat 

—q  a  Hi  l  3 


(7.6)  2- 


xl.  X  2. 


x(ll)  -- 

x(ii)x(2.; 


x(ll)  - 


x  l.  x 


x(H)x(.2) 


*(11) 


*"(11) 

n 
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Even  for  tnis  simple  case  Inverting  tne  matrix  in  (7.6)  Is  messy 
algenraically,  nowever.lt  is  easier  to  use  tne  relations  In  (4.10) 
and  (4.11).  We  nave  from  (7-1) 

(7*7)  Tj  -  tn  x(12)  -  tn  x(22),  Ta-tnx(21)  -tnx(22), 
ts-  tn  x(ll)  +  tn  x(22)  -  tn  x(12)  -  tn  x(21) 

and  from  ©a  -  x(l.),  ^  -  x(.l),  ©a  -  x(ll)  and  tne  relations 
Implied  in  Figure  7.1  It  Is  found  tnat 


(7.8) 

x(ll) 

-  ©3 ,  x(i2)  -  e1  -  o, , 

x(21)  -  6^  -©,  > x ( 22) -n-Qj^  +©s 

It  tnen  follows  tnat 

i  . 

1  St, 

1  3r,  11 

a©  " 

x(12) 

x(22)  ’  aoa 

x(22)  ’  3©s  x(12)  x(22) 

dTa 

&© 

1 

1 

x  ( 22)  ’ 

ilia.  _  1  . 

a®,  x(21)  + 

1  3ra  11 

x(22)  »  a©3  x(21)  x(22) 

(7.9) 

hr  3 

1 

1  dta 

1  1 

3©1  “ 

'  x (12) 

“  x(22)  »  3©a 

“  x(21)  "  x(22)  * 

3t3  _  1  +  1  t  1  +  1 

993  tc(ll)  x(12)  x  ( 21)  x(22) 


tnat  is,  tne  entries  of  since  St,  -  a1* . 

9  ™  N  A 
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Note  tnat  tne  value  of  tne  logarithm  of  tne  cross-product 
ratio  as  a  measure  of  association  appears  In  tne  course  of  tne 


analysis  as  tne  value  of  t#,  and  tnat  ts  -  0  for  x*(ij)  wnose 
representation  as  In  Figure  7.2  does  not  Involve  tne  last 
column.  Tne  minimum  discrimination  information  statistic  to 
test  tne  null  nypotnesis  of  independence  is  2l(x:x*).  In  tnis 
case  and  in  accordance  witn  (4.25) 


(7-10)  2I(x:x*)  «  (x(ll) 


x(l.)x(.l) 

n 


)S  C 


x*  (11)  x*  (12)  'x*  (21)  (x*  (22) 


Remembering  tnat  x*(ij)  -  x(i. )x( . j)/n,  tne  rignt-nand  side  of 

(7.10)  may  also  be  anown  to  De 

(7.11)  2  (x(ij)  -,x(l.)x(.j)/n)a/  X(10X(»J) 

..  •  n 

tne  classical  X3 -test  for  independence  witn  one  degree  of  freedom. 
A  test  wnicn  nas  been  proposed  for  tne  null  nypotnesis  of  no 
association  or  no  interaction  in  tne  2x2  taDle  is 

(7.12)  <t~  xta ))* 

wnicn  is  seen  to  be  tne  approximation  for  2I(x:x*)  in  terms  of  tne 
t'b  witn  tne  covariance  matrix  estimated  using  tne  observed  values 
and  not  tne  estimated  values.  We  remarx  tnat  if  tne  observed 
values  are  used  to  estimate  tne  covariance  matrix  tnen  instead 
of  tne  classical  Xs-  test  in  (7.11)  tnere  is  derived  tne  modified 
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Neyman  cni-square 

(7.13)  X’3  -  z(x(ij)  -  x(i.)x(.j)/n)a/x(ij) . 

8.  Example  wltn  experimental  data.  Consider  tne  R  x  S  x  T  x  u 
table  8.1a  representing  tne  results  of  test  snooting  under  tnree 
different  conditions: 

R:Gun  Darrel  wear:i-l,  new,  i-2,  moderate,  i-3,  excessive 

S:Gun  Darrel  temperature: j-1,  cold,  j-2,  not 

T:Unit  temperature :k-1,  not,  k-2,  ambient,  k-3,  cold 

U:  Number  operative :t-l,  success,  1-2,  failure. 

We  are  indebted  to  Mr.  B.M.  Kurxjian  of  tne  Harry  Diamond 

Laboratories  for  tne  data  and  nis  interest  in  tne  analytic 

procedure  we  nave  discussed.  We  note  tnat  15  rounds  eacn  were 

fired  under  eacn  of  18  experimental  conditions.  Tnis  is  not 

necessary  for  tne  application  of  tne  analysis  of  information 

procedures  but  was  required  for  tne  earlier  application  of 

Brandt's  analysis  to  tne  data. 

Figure  8.1  presents  a  grapnic  representation  of  tne 

regression  (4.7)  and  is  similar  to  tnat  in  Figure  7.2  for  tne 

2x2  table.  Tne  L  column  corresponds  to  tne  negative  of  tne 

logaritnm  of  tne  moment-generating  function  (a  normalizing  value) 

and  eacn  of  tne  otner  oolumns  is  a  T(u>)  function  witn  tne  associated 

t  value  at  tne  nead  of  tne  column.  Superscripts  and  subscripts 

are  used  to  identify  tne  factors  and  categories  involved.  Tne 

complete  representation  in  Figure  8.1  witn  tne  35  t  values  will 

provide  an  exact  representation  for  tne  observed  values  x(u>). 

Tables  8.2,  8.3,  and  8.4  are  analysis  of  information  taDles 

24 


presenting  appropriate  analyses  as  various  sets  of  marginals  of 
Interest  are  Introduced  as  explanatory  variables. 

In  Figure  8.2  tne  columns  corresponding  to  tne  T  parameters 
wnicn  enter  into  tne  various  distributions  appearing  in  tables 
8.2,  8.3  and  8.4  nave  been  cnecxed.  Note  tnat  for  nn,  tne 
uniform  distribution,  tnere  are  no  cnecxs,  and  for  x(u>),  tne 
observed  distribution  all  columns  are  cnecxed.  Tne  degrees  of 
freedom  for  any  effect  component  Is  tne  difference  In  tne 
number  of  columns  cnecxed  for  tne  corresponding  estimates.  Tne 
degrees  of  freedom  for  any  Interaction  component  Is  tne  difference 
In  tne  number  of  columns  cnecxed  for  tne  observed  x-distributJon 
and  tne  estimated  distribution. 

Tne  null  nypotnesis  for  any  effect  component  Ib  tnat  tne 

additional  t  parameters  are  zero,  for  example,  tne  null 

nypotnesis  for  tne  effect  component  2I(x£:x£)  In  table  8.2  is 
RU  RU 

tnat  t”  ,  t8i  are  zero.  Tne  null  nypotnesis  for  any  Interaction 
component  Is  tnat  tne  set  of  parameters  wnicn  are  cnecxed  for  tne 
observed  x-distrlbution  but  not  for  tne  estimated  distribution 
are  zero,  for  example,  tne  null  nypotnesis  for  tne  tnird-order 

Interaction  component  2l(x:xJ)  In  table  8.2  1b  tnat 

RSTU  „RSTU  _RSTU  aM  zero 
Tam  *  Tiiai  *  Taiai  are  zero* 

Note  tnat  all  tne  marginals  Implied  for  xj  In  table  8.4 
are  x(l«..),  x(.j..),  x(..K.),  x(...t),  x(lj..),  x(l.K.),  x(l..t), 
x ( . j x. ) ,  x(.j.t),  x ( 1  j k. ) ,  x(Ij'.t)  and  tne  marginals  Implied  for 
in  table  8.4  are  x(l.««),  x(.j..),  x(..x.),  x(...t),  x( 1 j . . ) , 
x  (1 .  x. ) ,  x(l..t)  ,x(.jk.)  ,x(.j.t),x(.  .Kt)  ,x(1jk.)  ,x(lj.;,)  ,x(i.x/,) , 
nence  tne  six  parameters  T^>TJ'f|T^'^,TRTUfTOTUfTM'U  appear  in 
x*  out  not  In  x*. 
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We  draw  tne  following  conclusions  from  tables  8.2,  8.3,  8.4: 

1.  Success/Pailure  is  not  Homogeneous  over  tne  18 
experimental  situations,  x*(ijKt)  -  x(1jk.)x( . . .t)/n,  2I(x:x{)  - 
34.371,  17  D.F. 


2.  Tne  effect  of  x(i..t)  in  table  8.2  is  almost  significant, 
but  tnose  of  x(.j.-t),  x(..K-t)  are  not  significant,  nence  we 
proceed  as  in  table  8.4. 

3.  Tne  marginals  x(1jk.),  x(ij.t),  x(i.Kt)  and  tne  lower 
order  marginals  tney  imply  provide  an  acceptable  estimate  for  tne 
original  data  since  2I(x:x*)  -  7.413,  6  D.F.,  tnat  is,  we  accept 
a  null  nypotnesis  tnat  tne  set  of  six  parameters  t®TU  »T?ai,» 

«  are  zero. 

4.  Using  Figure  8.1  and  Figure  8.2  we  can  express  tne 
logaritnm  of  tne  ratio  of  tne  estimates  for  success  to  failure 
under  all  18  experimental  conditions,  tnat  is,  tne  logit,  as 
tne  linear  combination  of  a  constant  term  t^,  a  term  depending 
on  barrel  wear  tr^,  t^,  a  term  depending  on  tne  interaction 
of  barrel  wear  ana  barrel  temperature  r‘^y ,  t8j  “ ,  and  a  term 
depending  on  tne  Interaction  of  barrel  wear  and  unit  temperature 
.RTU  tRTU  stu  rtu 

in  *  Tan  »  Tiau  Taai  • 


In 

x* (1112) 

in  \ (1211) 
x*1  (1212) 

tn 

xf  (2112) 

ln£(2211) 

x*  ( 2212) 


T?  +  T&  +  t??  +  rj?  +  rjw 


U  RU  TU  RTU 
Ti  +  T1X  +  vll  +  tix1 


„U  4.  -RU  ,  ,SU  ,  TU  ,  RSU 
Ti  +  Tai  +TU  +  Tn  +  Tan 


„U  4.  tru  4.  -TU  4.  -RTU 
Ti  +Tai  +  Tn  +  Ta,ii 


+  T 


RTU 

ill 


+  T 


RTU 

an 
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tn  ^131111  .  Tu  +  Tsy  +  ttu 
*51(3112)  1 

tn  <(3211)_  .  TU  +  fTU 
xj (3212) 

,  x#  (1121)  U  RU  SU  TU  ,  RSU  RTU 

‘  Tl  +  T“  T“  +  T81  Tl“  TlSi 

tn  -  tU  +  tRU  +  tTU  +  RTU 

7(1222)  11  8  181 

tn  -  TU  +  Tro  +  SU  +  tTU  +  RSU  +  RTU 

x* (2122)  11  1  “  1 

.  x? (2221)  U  ^  RU  ^  TU  RTU 

7*  (2222)  "  1  81  Tsi  Ts81 

tn  -  t,°  +  Tf“  +  T™ 

«J(  3122)  “  “ 

tn  ^<3^1  .  ,»  ♦  T™ 
if  (3222) 

xf  (1131)  U  ,  RU  ,  SU  ,  RSU 

'  T“  T“  T*‘‘ 

t„  iiiSJO  .  U  +  HU 

J?(1232) 

fCiSSL  -  Tf  +  T W  +  TfJ  +  TJS 

**(2132)  81  “  811 

tn  £<22311  _  U  +  TJ» 
x*  (2232)  1 
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tn  -  Tlu  +  T?y 

x* (3132) 


tn  -5 


(3231)  _  „U 
x*  (3232) 


“  T, 


5.  Since  tne  computer  program  provides  not  only  tne  values 
of  xJ(ijKt)  Dut  also  tne  values  of  tn  (xJ^ijKtJ/xJ  (3232) ) ,  tne 
values  of  tne  t's  in  conclusion  4  acove  can  be  easily  found. 

rF  _  tn  -  3.028I 

x* (3232) 


-  tn  -  Tlu  -  -  1.6470 

11  x* (1232) 


tRU  .  w  £(2231). 

x*  ( 2232) 


tF  -  -  2.2870 


rfF  .  |,n  x*(3131l  _  -  -  0.679^ 

1  x* (3132) 


TU  .  x*  (3211)  U  ,  „„„„ 

T  _  tn  -  T.  -  -  1.9759 

11  xjf  (3212)  1 


TU  x  (3221)  U 

r_ .  -  tn  -x-i - -  -  r  -  -  0.77^6 

xj  (3222) 


a  1 


RSU 


RSU 

ran 


-  tn  X|.^31L  -  t.U  -  tRU  -  Tf.U  --O.2928 

X.  (1132) 

-  tn  $1221  -  T,U  -  t®  -  rf?  -  1.7215 


RTU 

ri  11 


RTU 
rai  1 


x,  (2132) 


.  ...  -  T» 

*  /«!  rtl  TX 


x; (1212) 


rRU  -  t,™  -  2.3336 


'ii 


.  x* ( 2211)  U  RU  TU  .  i,__q 

*n  -il - -  -  t  -  t8.  -  t„  -  1.4528 

x^ (2212)  1  81  “ 
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_RTU  x*{1221)  u  RU  TU  „ 

T,  «. ,  *■  m  »  -  T,  -  f.  ,  -  T*  ,  “  0.IO39 

1  x* (1222)  1  “  81 

RTU  ,  x*  (2221)  U  RU  TU  n  ,-070 

Taa,  -  *n  -t-i - -  “  T  -  T_,  -  Tai  -  O.5070 

881  x* (2222)  1  81  1 

As  a  cnecx  we  nave,  for  example,  tn  (x*  (1111) /x* (1112) )  - 
0.7666  and  Tlu  +  TJ®  +  Tf”  +  T™  +  +  -  0.7666. 

6.  Tne  values  of  L  and  otner  t  parameters  for  tne  x* - 

distribution  can  be  obtained  from  Figure  8.1  and  tne  computer 
listing  of  tne  values  of  &n(x*  ( i J K<< ) /x* ( 3232))  and  tn(x*  (3232)/nrr) , 
in  tnis  case  nn  -  270/(3x2x3x2).  Tnus  L  -  -2.3822, 

-  tn(x* (1232) /x* (3232) )  -  1.4701,  etc. 

7.  Tne  computer  output  for  x*  (ijxt)  is  listed  as  taDle  8.5. 
Five  values  are  given  for  eacn  i,j,K,t,  tnese  are: 

Observed:  x(ijw,) 

Predicted:  x*(ljKt) 

Residual:  x(ijKt)  -  x*(ijKt) 

Standardize:  2  x(ijftt)  in  (x(ijKt)/x*  (ijKl) ) 

Log  ratio:  tn(x^ (ijKt)/xJ  (3232) ) . 

Tnere  is  also  given  tne  value  of  2I(x:x*)  along  witn  tne  degrees 
of  freedom  and  a  probability  based  on  tne  x»  -  distribution  and 
tne  value  of  L  as  log(x  STAR/N/CELLS ) . 


9.  AcKnowledgment .  Tne  interest  and  cooperation  of  Professor 
C.T.  Ireland  and  Dr.  H.H.  Ku  are  gratefully  acknowledged. 
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Original  Data  x(ijKt) 


.999  14.959  14-999  15-001  15.001 


Analysis  of  Information 
Table  8.2 


Component  due  to 

Information 

D.F. 

a)x(ijK.) 

2I(x:xJ)-99.639 

18 

d)x(1jk.)  ,x(. .  .1) 

U-effect 

2I(x*:x? )-65.268 

1 

Interaction 

2I(x:xf)  -34.371 

17 

c)x(ijK.) ,x(i. .1) 

RU-effect |RST 

2I(xJ:x»)-  5.303 

2 

Interaction 

2l(x:x»)  -29.068 

15 

d)x(ijK.) ,x(i. .4) ,x(. j.t) 

SU-effect |RST,RU 

2l(x*:x*)-  0.314 

1 

Interaction 

2l(x:x*)  -28.754 

14 

e)x(ijK.) ,x(l. .i) ,x(. j.t)  ,x( .  .Kt) 

TU-effect |RST,RUf SU 

2I(x*t:x*)-  2.705 

2 

Interaction 

21 (x:x*)  -26.049 

12 

f)x(IjK. )  ,x(.  .w,)  ,x(ij.t) 

RSU-effect |RST,RU,SU,TU 

2I(x*:x*)-  9.752 

2 

Interaction 

2l(x:x*)  -16.297 

10 

g)x(ijK.),x(lj.t),x(l.Kt) 

RTU-effect  |  RST,  RU,  SU,  TU,  RSU 

2I(if  :x*)-  8.891 

4 

Interaction 

2l(x:xj)  -  7-406 

6 

n)x(ijK.) ,x(Ij.t)  ,x(I.Kt) ,x(.jKt) 

STU-effectlRST,RU,SU,TU,RSHRTU2l(xJ:x^)-i  4.543  2 

Tnird-order  Interaction  2l(x:xJ)  -  2.863  4 
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Table  8.3 


Component  due  to 

Information 

D.P. 

d)x(ijK.),x(l..t),x(.j.t) 

2I(x:x*)  -  28.754 

14 

m)x(ljK.),x(ij.t) 

RSU-effect|  RST,RU,SU 

2I(x*:x*)  -  9-649 

2 

Interaction 

2I(x:xJ)  -  19.105 

12 

f)x(ijK.),x(ij.t),x(..Kt) 

TU-effect|  RST,RU,SU,RSU 

21  (x*  :x?)  -  2.808 

2 

Interaction 

2I(x:x*)  -  16.297 

10 

TaDle  8.4 

Component  due  to 

Information 

D.F. 

d)x(1jk.) ,x(. .  .1) 

2I(x:x* )  -  34.371 

17 

c)x(1jk.) ,x(i..t) 

RU-effectl  RST 

2I(x*:x*)  -  5.303 

2 

Interaction 

2I(x:xJ)  -  29.068 

15 

m)x('ljK.)  ,x(ij.t) 

RSU-effect|RST,RU 

21  (x*  :x£ )  -  9.963 

3 

Interaction 

2I(x:x^)  -  19.105 

12 

n)x(ijK.) ,x(ij.t) ,x(i.Kt) 

RTU-effect| RST, RU, RSU 

2I(x*:x*)  -  11.699 

6 

Interaction 

2l(x:x^)  -  7.406 

6 

x*  =  x* 

I  I 
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Taole  8.5 

C omputer  'Output- jc*1 

_ fit  S I  DUALS  ♦  R  »  S  »  T  »  U.  FIRST  J  SUBSCRIPTS: _ J _ 1 


1  2 


1  OBSERVED 

1 

9.00CO0O 

6.000000 

1  PREDICTED 

2 

10.241535 

4.758C02 

1  RESIDUAL 

3 

-1.24  1535 

1.241998 

1  STANDARDIZE 

4 

-1.163043 

1  .391587 

1  LOG  RATIO 

5 

2  OBSERVED 

6 

8.00C000 

7.000C00 

2  PREDICTED 

7 

6.746210 

8  .254419 

2  RES  I  DUAL 

8 

1.252790 

-1.254419 

2  STANDARDIZE 

9 

1.362679 

-1  .153870 

2  LOG  RATIO 

10 

.  _  _  2. 276293_ 

_  _  2.478C61 

3  OBSERVED 

11 

9. OOCOOO 

6.000000 

3  PREDICTED 

12 

9.012303 

5  .987520 

3  RESIDUAL 

13 

-0.012303 

0.012480 

3  STANDARDIZE 

14 

-0.012295 

0  .012490 

3  LOG  RATIO 

15 

_ £i2£522i- 

_ iusiiea 

RESIDUALS  1  R  *  S  *  T  *  U.  FIRST 

2  SUBSCRIPTS: 

1 

2 

1 

_ 2 — 

l 

OBSERVED 

1 

14. OOCOOO 

1  .OOOCOO 

1 

PREDICTED 

2 

12. 75  £455 

2.241997 

1 

RESIDUAL 

3 

1.24  1545 

-1  .241997 

1 

STANDARDIZE 

4 

1.30C076 

-0.807267 

1 

LOG  RATIO 

5 

U2125Q& _ 

_ U1146I2  _ 

2 

OBSERVED 

6 

9. OOCOOO 

6. OOOCOO 

2 

PREDICTED 

7 

1C. 252795 

4.745572 

2 

RESIDUAL 

8 

-  1.253795 

1.254426 

2 

STANDARDIZE 

9 

-1.173809 

1  .407280 

2 

LOG  RATIO 

10 _ 

£*.£24262 

_ U2U5Z2 

3 

OBSERVED 

11 

12. OOCOOO 

3  .OOOCOO 

3 

PREDICTED 

12 

1 1.987688 

3.012478 

3 

R  ES I  DUAL 

13 

0.012312 

-0.012478 

3 

STANDARDIZE 

14 

0.01 2308 

-0.012452 

3 

LOG  RATIO 

15  _ 

_ £t£5il2£ _ 

_ 

RESIDUALS :  R  *  S  * 

T  *  U. 

FIRST  2  SUBSCRIPTS:  2  l 

1  2 
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I 


I 

OBSERVED 

1 

1  l. 00 0000 

4  .OOOCOO 

I 

PRECICTEO 

2 

1  1.685621 

3.314257 

I 

RESIDUAL 

3 

-0.685621 

0.685743 

1 

STANDARDIZE 

A 

-0.665103 

0.752241 

I 

LOG  RATIO 

5 

_  2*625612 

_ 1*565565 

2 

OBSERVED 

6 

14. OOCOOO 

1  .OOOCOO 

2 

PREDICTED 

7 

12.472881 

2.527158 

2 

RESIDUAL 

8 

1.527119 

-1.527158 

2 

STANDARDIZE 

9 

1.617001 

-0.927C95 

2 

LUG  RATIO 

10  _ 

_  2*62£666 

JL*2266J2I 

3 

OBSERVED 

11 

12. OOCOOO 

3  .OOOCOO 

3 

PREDICTED 

12 

12.  84  1480 

2.158594 

3 

RESIDUAL 

13 

-0.84  1480 

0  .841406 

3 

STANDARDIZE 

14 

-0.81 2287 

0.987465 

3 

LOG  RATIO 

15 

_ 2*212222_ 

_ 1*126262 

RESIDUALS:  R  »  S  *  T  »  L.  FIRST  2  SUBSCRIPTS: _ 2 _ 2 


1 

2 

1 

OBSERVED 

1 

9. OOCOOO 

6. OOOCOO 

l 

PREDICTED 

2 

8.314383 

6.685740 

1 

RESIDUAL 

3 

0.685617 

-0.685740 

1 

STANDARDIZE 

4 

C. 713138 

-0.649305 

1 

LOG  RATIO 

5 

_ 2*665222 _ 

_ 2*261222 

2 

OBSERVED 

6 

8. OOCOOO 

7. OOOCOO 

2 

PREDICTED 

7 

9.527126 

5.472640 

2 

RESIDUAL 

8 

-1.527126 

1  .527  160 

2 

STANDARDIZE 

9 

-  1.357613 

1 .722786 

2 

LCJG  RATIO 

10 

_  2*621555  __ 

_ 2*061112 

3 

OBSERVED 

11 

1  1. OOCOOO 

4. OOOCOO 

3 

PREDICTED 

12 

1C. 156509 

4.841  *.04 

3 

RESIDUAL 

13 

0.84  1491 

-0.841404 

3 

STANDARDIZE 

14 

C. 875411 

—0 .763642 

3 

LUG  RATIO 

15 _ 

_ 2*625621 _ 

_ 1*266516 

RESIDUALS:  R  *  S  *  T  *  U.  FIRST 

2  SUBSCRIPTS: 

3 

1 

1 

2 

1 

OBSERVED 

l 

9. OOCOOO 

6. OOOCOO 

1 

PREDICTED 

2 

8.882741 

6.118252 

1 

RESIDUAL 

3 

C. 117259 

-0.118252 

1 

STANDARDIZE 

4 

0.116029 

-0.117102 

l 

LOG  RATIO 

5 

_ 2*551622. 

_ 2*112566 

2 

OBSERVED 

6 

1 3. OOCOOO 

2. OOOCOO 

2 

PREDICTED 

7 

12.425370 

2  .574304 

2 

RESIDUAL 

8 

0.574630 

-0.574304 

2 

STANDARDIZE 

9 

0.567705 

-0.504664 

2 

LOG  RATIO 

10 

2.867053 

-1*212621 

3 

OBSCRV ED 

11 

13.000000 

2.000000 
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3 

PREDICTED 

12. 

.  _  .  13.691921  . 

1.307411  . 

3 

RESIDUAL 

13 

-0.691921 

0.692589 

3 

STANDARDIZE 

14. 

-G. 674136 

0.850196 

3 

LOG  RATIO 

15 

ixsaiiifl.. 

_ 2x622261 

RESIDUALS:  R  *  S  *  T  *  U.  FfRST  2  SUBSCRIPTS":  3  2 

_ _ _ 1 _ 2 _ 


1 

OBSERVED 

1 

1 l.OOCOOO 

4 .OOOCOO 

1 

PREDICTED 

2 

1 1.117260 

3 .881743 

1 

RESIDUAL 

3 

-C.  1  1  7260 

0.118257 

1 

STANDARDIZE 

4 

-0.116640 

0 .120C37 

1 

LOG  RATIO 

5  . 

2x2255 IQ. 

-1x223252 

2 

OBSERVED 

6 

13.00C000 

2 .OOOCOO 

2 

PREDICTED 

7 

13.574622 

1 .425645 

2 

RESIDUAL 

8 

-C. 374622 

0.374305 

2 

STANDARDIZE 

9 

-0.562285 

0  .676574 

2 

LOG  RATIO 

10  _  . 

__.2x2255.L2. 

_QxI21572 

3 

OBSERVED 

11 

1 3.00C000 

0 .000C05 

3 

PREDICTED 

12 

14.308073 

0 .692  393 

3 

RESIDUAL 

13 

0.691927 

-0.692588 

3 

STANDARDIZE 

14 

0. 708390 

-0  .000C39 

3 

LOG  RATIO 

15 

2x225135. 

_  =J2xJB2fl£fil  ...  . . . 

HYPOTHESIS  4 

21 ( X: X*  )  * 

7.406 

DEGREES  OF  FKEEDUM 

6 

PROBABILITY  UP  A  LARGER 

VALUE  * 

0.284956 

LOG (XSTAR/N/C ELLS)  =' . ""  -2.382215 
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